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Abstract 



Ant-based algorithms are successful tools for solving complex problems. One of these problems is the Linear Ordering 
Problem (LOP). The paper shows new results on some LOP instances, using Ant Colony System (ACS) and the Step- 
<N ^Back Sensitive Ant Model (SB-SAM). 
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Linear Ordering Problem (LOP) is an NP-hard prob- 
lem 

B G3- In graph theory, LOP is searching for an 
acyclic tournament having the maximum sum of arc weights 
in a complete weighted graph. In other words, LOP is seek- 
ing a permutation of rows and columns in a given matrix 
of weights in order to maximize the sum of weights in the 
upper triangle 13, 11 1 . 



Several methods were proposed to solve the Linear Or- 
dering Problem. Exact methods 13, TBI 16 1 and heuris- 
tic methods were proposed to address LOP algorithms. 
Heuristics are more efficiently in finding near-optimal so- 
lutions to LOP: tabu search @, [ll|, scatter search it- 
erated local search 12|, sorting through insertion pattern 
and permutation reversal Q and evolutionary algorithms 
[18]. 

Some evolutionary approaches to LOP presented and 
analyzed by Snasel et al [18| use two approaches: mutation 
only genetic algorithm and higher level chromosome ge- 
netic algorithm. These evolutionary methods obtain good 
results for problem instances from the library proposed by 
Mitchell and Borchers 13 1. 

Two ant-based models are described for solving LOP: 
a hybrid model based on the Ant Colony System (ACS) 
@, |||, called Ant Colony System- Insert Move (ACS-IM) 
presented in [3] and the second model is an extended 
version of the Sensitive Ant Model (SAM) Q which com- 
bines stigmergic communication with heterogeneous agent 
behavior. This technique, called Step Back Sensitive Ant 
Model (SB-SAM) @ extends SAM method by defining 
new (virtual state) behavior for ants having a certain sen- 
sitivity level. Lasius niger ants [l[ include u-turns in the 
process of selection which have a high impact on the qual- 
ity of the detected paths. Inspired by Lasius niger ants 
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behaviour, the virtual state transition rule avoids a selec- 
tion of the next step from the available nodes making the 
agent to take a step back to the previous node and explore 
other regions of the search space. 

The SB-SAM virtual state based decision making pro- 
cess generates a benefic exploratory behavior of the sys- 
tem which is balanced by the exploitation orientation of 
the highly sensitive agents in the system. 

The paper reports new results for the artificial LOP 
larg e instances data generated by Mitchell and Bochers 
[13j. Both ant based techniques produce high-quality re- 
sults for of LOP competing with two genetic algorithms: 
Mutation Only Genetic Algorithm (MOGA) and Higher 
Level Chromosome Genetic Algorithm (HLCGA) [18j. The 
results reported by SB-SAM are better than those of ACS- 
IM and the already mentioned genetic algorithms. This 
is indicating the potential of inducing heterogeneity in 
ant-based models for better addressing difficult problems 
where complex behavior patterns are needed. 

Numerical experiments on several LOP instances avail- 
able in the well-known real-world data library LOLIB 19] 
are reported in This paper is organized as follows: 
the linear ordering optimization problem is described; ant 
colony models are described; numerical experiments and 
comparisons are discussed and directions for future re- 
search are presented. 

2. The Linear Ordering Problem 

One of the well-known NP-hard problem is the Lin- 
ear Ordering Problem (LOP). LOP is equivalent in eco- 
nomics with the triangulation problem for input-output 
tables in economics HB]. Single-server scheduling, 

ranking by aggregation of individual preferences in group 
decision making, archaeological seriation are other appli- 
cations [ii. Hlj. 



In order to introduce LOP, let E = (eij) nxn be a ma- 
trix of weights. The value of ejj refers to the cost of having 
object i before object j in the linear ordering. 

LOP aims to find a permutation of the rows and columns 
7r = (7Ti, 7T2, • • • , 7r n ) such that the total weight (sum of el- 



ements above the diagonal) is maximized ll|, Il5j : 
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An acyclic tournament corresponds to a permutation 
of the graph vertices. Let G — (V, E, w) be a complete 
graph. V is the set of nodes and E contains the vertices of 
the graph and w refers to the weight (or cost) associated 
with an edge (the weight from i to j can be different that 
the weight of j to i). The function to be maximized in 
LOP is the following: 



(2) 



where it is a permutation of V, i,j(zV and < is a total 
order relation on V. 



3. Ant-based model for solving LOP 

The ant-based models involved in the present paper to 
solving Linear Ordering Problem are described shortly in 
the following. 

A Ant Colony Systems 

Ant Colony System (ACS) metaheuristic is introduced 
in (SHI- The ACS model replicates the behavior of so- 
cial insects to the search space represented commonly 
by a graph. Each edge has an associated weight as well 
as a pheromone value corresponding to a desirability 
measure. A problem solution is a complete tour gener- 
ates a by an ant. The next node in the graph is choose 
probabilistically based on the weight and the amount 
of pheromone on the connecting edge Q- Stronger 
pheromone trails are preferred by ants and the most 
promising tours build up higher amounts of pheromone 
in time. 

B Ant Colony System-Insert Move 

The ACS model for solving LOP is called Ant Colony 
System-Insert Move (ACS-IM) ACS-IM starts with 
a greedy search. ACS-based rules are applied and a lo- 
cal search mechanism based on insert moves is engaged. 
The local search mechanism is based on the neighbor- 
hood search proposed for LOP [§]. Insert moves (IM) 
are used to create a neighborhood of permutations for 
one solution. 

C Sensitive Ant Model 

The Sensitive Ant Model (SAM) extends ACS by in- 
ducing heterogeneity in the ant population 



Each ant is endowed with a pheromone sensitivity level 
(PSL - a real number in the unit interval). Highly- 
sensitive ants are influenced by stigmergic information 
in the decision making process and thus likely to select 
strong pheromone trails. The ants with low sensitiv- 
ity tend to ignore the amount of pheromone and bias 
the search towards unexplored regions. The new SAM 
probability of selecting the next node is the same with 
the ACS one when pheromone sensitivity level (PSL) 
value is maximum being reduced proportionally with 
the sensitivity level in the rest of the cases. A virtual 
state is introduced in SAM corresponding to the lost 
probability of (1 PSL). The associated virtual state 
decision rule specifies the action to be taken when the 
virtual state is selected using the renormalized transi- 
tion mechanism j4j]. 

D Step-Back Sensitive Ant Model 

The Step-Back Sensitive Ant Model (SB-SAM) [B| is 
based on the Sensitive Ant Model (SAM) 0]. The aim 
of SB-SAM is to better exploit the potential of the vir- 
tual state translating to a more reliable search space 
exploration. This is achieved by specifying a new ac- 
tion associated with the virtual decision rule inspired 
by the observed behavior of the ant Lasius niger 
Biologistss study emphasize that some Lasius niger sud- 
denly move in the opposite direction making a u-turn 
and exploiting the geometry of the trail network bifur- 
cation These u-turns actually contribute more to 
the selection of a path compared to bi-directional trail 
laying. SAM reinforce the inherent heterogeneity of the 
model facilitating a significant increase of diversity in 
the search. The virtual state transition rule specified by 
SB-SAM makes the ant to take a step back by selecting 
the previous node [5j. The pheromone trail is locally 
updated by decreasing the pheromone intensity on the 
edge connecting the current node with the previous one. 
The local virtual state update rule complements is given 
by the following equation: 



Tji(t + !) = (!- p)Tij - pr 



(3) 



where Tji represents the amount of pheromone on edge 
(j, i) while p and To are the same parameters used in the 
ACS local updating rule 0) ■ The search continues from 
the new current node until a complete tour is built. The 
probability of an ant to take the virtual state decision 
is inverse proportionally with the ants sensitivity level: 
lower PSL means higher chance to take a step back 
whereas high PSL values favor the application of the 
ACS-inherited state transition rule. 
The step-back virtual decision rule generates completely 
new overall behavior for the system of interacting ants 
triggering search diversity. A good distribution of PSL 
values in the population is important to create a bal- 
ance in the search space between the exploitation and 
exploration [5|. 
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1) Representation and initialization. 



Instance Optimal ACS-IM SB-SAM 



Linear Ordering: Problem solution is a list of vertices, 
of a complete directed graph with n nodes. The list is 
constructed in a step by step manner by each ant based 
on the transition rules specified by the ant model. The 
algorithm is based on ACS-IM [lj]. It is initialized 
with a greedy solution obtained based on a 2-exchange 
Neighborhood search, permuting two positions in the 
ordering [l~7l ]. 

A function w assigns real values (the weights) to edges 
defining the static matrix of weights W = (wij), 1 < 
hj < n - The pheromone matrix r has the same di- 
mensions as W. The pheromone matrix r is initialized 
with Tij = to, 1 <i,j<n where To is a small positive 
constant. The SB-SAM algorithm uses m ants. A PSL 
value is randomly generated for each ant. The ants are 
initially randomly placed in the nodes of the graph. 




Figure 1: Step-back technique representation 

2) Solution construction. 

The SAM renormalized transition probabilities Q guide 
the selection of the next node in the search process. 
The probability of choosing the next node u from the 
current node i for an agent k is given by the following 
equation: 

sp iu {k) = PSL{k)*p iu {k) (4) 

where PSL(k) represents the sensitivity level of agent 
k and Pi U {k) is the ACS state transition probability 
0- The ACS local update pheromone rule |7j is ap- 
plied to modify the amount of pheromone on the latter 
edge traversed. The probability of an ant k to make a 
virtual state transition from a current node i is equal to 
(1 — Y2Piu(k))- In this case, ant k goes back to the pre- 
vious node and the local virtual state update rule (3) 
is applied. Insert moves (IM) are used to improve 
the final solution detected by an ant. A global update 
pheromone rule [7j is applied to the edges belonging to 
the best tour: 

Tij (t+l) = (l- P )*T ij + -?- (5) 

where Cb s is the weight of the best-so-far solution and 
p is a parameter. 
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Table 1: Numerical results of ACS-IM and SB-SAM for the MBLIB 
instances: Deviation errors average over five runs and 200 iterations. 



4. New results for Mitchell and Bochers Instances 
(MBLIB) 

This is the main section of the paper, reporting new 
results for the artificial LOP data collection generated by 
Mitchell and Bochers [l3T |. Besides comparing the perfor- 
mance of the two ant-based models ACS-IM and SB-SAM, 
numerical experiments focus on evaluating the proposed 
ant LOP models against Mutation Only Genetic Algo- 
rithm (MOGA) and Higher Level Chromosome Genetic 
Algorithm (HLCGA) 0. 

The following parameters are used for ACS-IM and SB- 
SAM algorithms: a = 1, /3 = 2, r = 0.1, p = 0.1, q = 0.5 
and m = 10. In the SB-SAM approach, the PSL value 
for each agent is randomly generated using an uniform 
distribution. 

Table [T] shows the results for the instances available in 
MBLIB [13j . The deviation of the obtained solution from 
the optimum solution is computed based on the average 
over five runs of the algorithm with 200 iterations. 



3 



Size 100 



0O350 
00O45 
0.004J 
0.0035 
0030 
00935 
O.DMO 
0.0015 




A. 












■>» 

\ 


f 

* ..« 


\ 


- 






B> ■ ■ ■ 


a** 


\ 




- 












c 


i 






















0.D010 














0.0005 
DOCK 



























- (-SB-! 



Size 150 



O0Q36 
OCWJO 



■g 0OKS 



0.0020 



/a 



-H SB-SAM 



Figure 2: Comparative ant models deviation errors: MBLIB in- 
stances, size 100 and 150. 
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Figure 3: Comparative ant models deviation errors: MBLIB in- 
stances, size 200 and 250. 
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Table 2: Deviation error (in %) of ant-based models compared to 
evolutionary approaches [ill for MBLIB instances. 



The analysis of the results for each problem size (100- 
250) confirms the results obtained for MBLIB (see Figures 
2-3). SB-SAM algorithm shows an intensification of search 
in more complex spaces. The effects of the u-turns spec- 
ified by the virtual state transition rule in SB-SAM (re- 
sulting in search diversification) are more visible for higher 
dimension problem instances. 

In the following the comparison of ant-based models 
with Mutation Only Genetic Algorithm (MOGA) and Higher 
Level Chromosome Genetic Algorithm (HLCGA) [IS] - Av- 
erage overall results for MBLIB instances are available for 
these algorithms in l_8j . Table shows the average devi- 



ation obtained by all involved algorithms for MBLIB in- 
stances. In 0] are proposed also some hybrid models com- 
bining variable neighborhood search and different strate- 
gies for local search. Local search strategies are limited by 
the dimension of problem instances. 

Further work will focuses on other hybrid ant-based 
techniques in order to obtain better solution for large LOP 
instances. 

5. Conclusions 

The paper shows new results for Linear Ordering Prob- 
lem (LOP) using bio-inspired models. The ant-based mod- 
els for solving LOP are described: the first one is a hybrid 
Ant Colony System Q, called Ant Colony System-Insert 
Move (ACS-IM) |l4[ and the second one uses a new Step- 
Back Sensitive Ant model [4j, [5j. The ant models compete 
with other techniques for solving LOP in terms of solution 
quality. 

Numerical experiments indicate a better performance 
of SB SAM in solving large Mitchell instances [l3T |. com- 
pared to the ACS-IM technique and two genetic algorithms: 
Mutation Only Genetic Algorithm (MOGA) and Higher 
Level Chromosome Genetic Algorithm (HLCGA) [11]. Other 
hybridization techniques for solving NP-hard problems, in- 
cluding Linear Ordering Problem will be developed. 
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